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■ Abstract. The group isomorphism problem asks whether two given groups 
\ are isomorphic or not. Whereas the case where both groups are abelian is 

■ well understood and can be solved efficiently, very little is known about the 
complexity of isomorphism testing for nonabelian groups. In this paper we 

g3 ! study this problem for a class of groups corresponding to one of the simplest 

Q ■ ways of constructing nonabelian groups from abelian groups: the groups that 

\ are extensions of an abelian group yl by a cyclic group Z^- We present an 

, efficient algorithm solving the group isomorphism problem for all the groups 

of this class such that the order of A is coprime with m. More precisely, our 
algorithm runs in time almost linear in the orders of the input groups and 
^yy . works in the general setting where the groups are given as black-boxes. 
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1 Introduction 



The group isomorphism problem is the problem of deciding, for two given groups G and 
\ H, whether there exists an isomorphism between G and H, i.e. a one-one map preserving 

CN ■ the group operation. This is a fundamental problem in computational group theory but 

little is known about its complexity. It is known that the group isomorphism problem (for 
groups given by their multiplication tables) reduces to the graph isomorphism problem 
I [13j, and thus the group isomorphism problem is in the complexity class NP n coAM 

' (since the graph isomorphism problem is in this class [2]). Miller [IB] has developed a 

general technique to check group isomorphism in time 0(n'°s"''''^*-^^), where n denotes the 
^ \ size of the input groups and Lipton, Snyder and Zalcstein [15] have given an algorithm 

^ • working in O(log^n) space. However, no polynomial algorithm is known for the general 

^ case of this problem. 

Another line of research is the design of algorithms solving the group isomorphism 
problem for particular classes of groups. For abelian groups polynomial time algorithms 
follow directly from efficient algorithms for the computation of Smith normal form of 
integer matrices |lll [6]. More efficient methods have been given by Vikas [21] and Kavitha 
[12j for groups given by their multiplication tables. The current fastest algorithm solving 
the abelian group isomorphism problem for groups given as black-boxes has been developed 
by Buchmann and Schmidt ^ and works in time 0(n"'^/^ (log n)'^^^)). However, as far as 
nonabelian groups are concerned, very little is known. For solvable groups Arvind and 
Toran [l] have shown that the group isomorphism problem is in NP H coNP under certain 
complexity assumptions but, to our knowledge, the only polynomial-time algorithm testing 
isomorphism of a nontrivial class of nonabelian groups is a result by Garzon and Zalcstein 
[7], and holds for a very restricted class. 
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In this work we focus on the complexity of the group isomorphism problem over classes 
of nonabelian groups. Since for abelian groups the problem can be solved efficiently, we 
study one of the most natural next targets: cyclic extensions of abelian groups. Loosely 
speaking such extensions are constructed by taking an abelian group A and adding one 
element y that, in general, does not commute with the elements in A. More formally the 
class of groups we consider in this paper, denoted J^, is the following. 

Definition 1.1. Let G be a finite group. We say that G is in the class .5^ if there exists 
a normal abelian subgroup A in G and an element y £ G of order coprime with \A\ such 
that G = {A,y). 

In technical words G is an extension of an abelian group ^4 by a cyclic group Z^, with 
gcd{\A\,m) = 1. We will say more about mathematical properties of these extensions in 
Section [2l For now, we mention that this class of groups includes all the abelian groups 
and many non-abelian groups too. For example, for A = Z,^ and m = 4 we will show that 
there are exactly 9 isomorphism classes in 

A group can be represented on a computer in diff'erent ways. In this paper we use the 
black-box setting introduced by Babai and Szemeredi [1], which is one of the most general 
models for handling groups, and particularly convenient to discuss algorithms running in 
sublinear time. In order to state precisely the running time of our algorithm, we introduce 
the following definition. 

Definition 1.2. For any group G in the class , let 7(G) be the smallest integer m such 
that G is an extension of an abelian group A by the cyclic group with gcd{\A\,m) = 1. 

The main result of this paper is the following theorem. 

Theorem 1.1. There exists a deterministic algorithm checking whether two groups G 
and H in the class 5^ given as black-box groups are isomorphic and, if this is the case, 
computing an isomorphism from G to H . Its running time has for upper bound {y/n + 
where n = min{\G\,\H\) and j = min{j{G),'~f{H)). 

Notice that, for any group G in the class ,y, the relation 7(G) < \G\ holds. Then the 
complexity of our algorithm has for upper bound n^'^"^^\ and is almost linear in the size 
of the groups. Another observation is that, if 7 = 0(n^/^), then the complexity of our 
algorithm is n^/'^+°^^^ and is of the same order as the best known algorithm testing isomor- 
phism of abelian groups [5] in the black-box setting. This case 7 = 0(n^/^) corresponds to 
the rather natural problem of testing isomorphism of extensions of a large abelian group 
by a small cyclic group. 

The outline of our algorithm is as follows. Since a group G in the class may in 
general be written as the extension of an abelian group Ai by a cyclic group Z^i and as 
the extension of an abelian group A2 by a cyclic group with Ai ^ A2 and nii 7^ m2, 
we introduce (in Section [3]) the concept of a standard decomposition of G, which is an 
invariant for the groups in the class y in the sense that two isomorphic groups have 
similar standard decompositions (but the converse is false). We also show how to compute 
a standard decomposition of G efficiently. This allows us to consider only the case where 
H and G are two extensions of the same abelian group A by the same cyclic group Z^. 
One of the main technical contributions of this paper is an efficient algorithm that tests 
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whether two automorphisms of order m in the automorphism group of A are conjugate or 
not (Section U]). Finally, we present a time-efficient reduction from the problem of testing 
whether G and H are isomorphic to an instance of the above conjugacy problem (Section 

Remark. The problem of deciding whether two group extensions are isomorphic has 
been studied by mathematicians for a long time. Mathematical results on the isomor- 
phism of semidirect products are known, e.g. [13], but to our knowledge do not give 
computationally efficient criterions for the isomorphism of groups in the class J/'. More 
generally several algorithms for the group isomorphism problem performing relatively well 
in practice are known and have been implemented in computational group theory soft- 
wares (GAP, MAGMA,...). The main works in this area are the algorithms developed by 
Smith for solvable groups [22] and by O'Brien [17j for p-groups. However these algorithms 
involve computation in groups of size exponential in re, e.g. the automorphism groups or 
the cohomology groups, and no rigorous analysis of their time complexity is available. 

2 Preliminaries 

We assume that the reader is familiar with the basic notions of group theory and state 
without proofs basic definitions and properties of groups we will use in this paper. 

Let G be a finite group (in this paper we will consider only finite groups). For any 
subgroup H and any normal subgroup K G we denote by HK the subgroup {hk \ h G 
H,k £ K} = {kh \ h £ H, k £ K}. Given a set S of elements of G, the subgroup generated 
by the elements of G is written (S). We say that two elements gi and 52 of G are conjugate 
if there exists an element y £ G such that §2 = ygiy~^. Two subgroups Hi and H2 of 
G are conjugate if there exists an element y £ G such that Hi = yH2y^^- For any two 
elements g,h £ G we denote [g, h] the commutator of g and h, i.e. [g, h] = ghg^^h^^ . The 
commutator subgroup of G is defined as G' = {[g,h]\ g,h £ G). The derived series of G is 
defined recursively as G(°) = G and G^^+i) = (G^*))'. The group G is said to be solvable 
if there exists some integer k such that G^*^^ = {e}. Given two groups Gi and G2, a map 
(/) : Gi — > G2 is a homomorphism from Gi to G2 if, for any two elements g and g' in Gi, 
the relation (p{gg') = 4>{g)(p{g') holds. We say that Gi and G2 are isomorphic is there 
exists a one-one homomorphism from Gi to G2, and we write Gi = G2. 

Given a prime p, a p-group is a group of order p*" for some integer r. It is well-known that 
any p-group is solvable. If G is a group and |G| = p^^ . . .pp^ for distinct prime numbers 
Pi such that pi < • ■ ■ < Pr, then for each i £ {1, . . . ,r} the group G has a subgroup of 
order p^' called a Sylow pj-subgroup of G. Moreover, if G is additionally abelian, then 
each Sylow pj-group is unique and G is the direct product of its Sylow subgroups. Abelian 
p- groups have remarkably simple structures: any abelian p- group P is isomorphic to a 
direct product of cyclic p-groups Zp^i x • • • x Zpcj, for some positive integer s and positive 
integers ei < ... < e^, and this decomposition is unique. A total order ^ over the set 
of prime powers can be defined as follows: for any two prime powers and where 
a and (3 are positive integers, we write ^ if and only if {p < q) or {p = q and 
a < P). We say that a list (gi, . . . , gt) of t elements in G is a basis of an abelian group 
G if G = {gi) X • • • X (gt), the order of each g^ is a prime power and \gi\ ^ \gj\ for any 
^ ^ i ^ j ^ n. It is easy to show that any (finite) abelian group has a basis and that, 
if (gi,...,gt) and (g'l, . . . , g'^,) are two bases of G, then t = t' and \gi\ = \g^\ for each 
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i £ {1, . . . ,t}. For example, ((71, ... , g^) is a basis of G = Z2 x Z4 x Z3 if and only if t = 4, 
\9i\ = 2, I52I = 4, I53I = 1541 = 3 and G = (51) x (52) x (53) x (54). 

Let n be a positive integer. A Hall divisor of n is a positive integer m dividing n such 
that m is coprime with n/m. A subgroup H of a finite group G is called a Hall subgroup 
of G if |-fr| is a Hall divisor of |G|. We will use in this paper the following well-known 
theorem. 

Theorem 2.1 (Hall's theorem). Let G be a finite solvable group and r be a Hall divisor 
of \G\. If Hi and H2 are two subgroups of G with \Hi\ = \H2\ = r, then Hi and H2 are 
conjugate. 

We say that a finite group G is an extension of a group K hy a. group L if there exists a 
normal abelian subgroup N = K of G such that G/N = L. We say that such an extension 
splits if there exists some subgroup M of G such that G = NAI and N f] M = {e}. The 
Schur-Zassenhaus theorem states that any extension of K hy L such that gcd{\K\, |L|) = 1 
splits. Split extensions can be constructed using the concept of semidirect products. Given 
two finite groups K and L, and a homomorphism <j) : L ^ Aut{K), where Aut{K) denotes 
the group of automorphisms of K, the semidirect product group x<^ L is the group with 
ground set {{k,e)\k £ K,£ £ L} and group product (fei, £1) o (/c2, -^2) — (^i0(-^i)(^2); ^1^2)- 
The direct product is the special case where (j) is the trivial homomorphism. It is well 
known that a group is a split extension of K hy L if and only if it is isomorphic to the 
semidirect product K yi^ L for some homomorphism (j) : L ^ Aut{K). We usually drop 
the subscript of x^ in the notation of the semidirect product when cp is implicit or not 
important. Thus an equivalent definition for the class is the following: a group G is in 
J/' if and only if there exist an abelian group A and a cyclic group with gcdd A| , m) = 1 
such that G = j4 X Z^- 

In this paper we work in the black-box setting first introduced in [3]. A black-box 
group is a representation of a group where elements are represented by strings (of the 
same length). An oracle that performs the group product is available: given two strings 
representing two elements g and g' , the oracle outputs the string representing g-g' . Another 
oracle that, given a string representing an element g, computes a string representing the 
inverse g~^ is available as well. In this paper we assume the usual unique encoding 
hypothesis, i.e. any element of the group is encoded by a unique string. We say that a 
group G is input as a black-box if a set of strings representing generators {gi, . . . ,gs} of 
G with s = 0(log|G|) is given as input, and queries to the multiplication and inversion 
oracles can be done at cost 1. The hypothesis on s is natural since every group G has 
a generating set of size 0(log|G|), and enables us to make the exposition of our results 
easier. The complexity of our algorithm (the bound {^/n + in Theorem II. ip is 

unchanged if s = IGj"^^-* and is still polynomial for any larger value of s. Also notice that 
a set of generators of any size can be converted efficiently into a set of generators of size 
0(log|G|) if randomization is allowed [3]. 

3 Computing a Standard Decomposition 

For a given group G in the class ,y in general many different decompositions as a 
semidirect product of an abelian group by a cyclic group exist. For example, the abelian 
group Zg = {xi,X2 \ Xi = X2 = [xi,X2] = e) can be written as (xi) x (X2), (^2) x (xi) or 
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{xi,X2) X {e}. That is why we introduce the notion of a standard decomposition. Let us 
first start with a simple definition. 

Definition 3.1. Let G be a finite group. For any positive integer m denote by &q the 
set (possibly empty) of pairs {A,B) such that the following three conditions hold: (i) A is 
a normal abelian subgroup of G of order coprime with m; and (ii) B is a cyclic subgroup 
of G of order m; and (Hi) G = AB. 

Notice that if for some m the set SIq is not empty, then G is in the class 5^. Conversely, 
if G is in o5^, then there exists at least one integer m such that SIq is not empty. Also 
notice that 7(G) is the smallest positive integer such that ^'q^'^ 7^ 0. We now define the 
concept of a standard decomposition. 

Definition 3.2. Let G be a group in the class 5^ . A standard decomposition of G is an 
element of Sf^^^ . 

The following simple lemma will be very useful. 

Lemma 3.1. Let G be a group in 5^ and m be any positive integer. If {Ai,Bi) and 
{A2,B2) are two elements of S!q , then Ai = A2. 

Proof. Let us write Bi = (yi). Any element g of A2 can be written as g = hyf with h G Ai 
and some integer c. If c ^ mod m, then gcd{m, \g\) ^ 1, which is excluded since \A2\ 
and m are coprime. Then A2 ^ ^1. By symmetry Ai C A2 and Ai = A2. □ 
Before explaining how to compute a standard definition for a group in ^5^, let us mention 
that it is well known that the order of an element g of any finite group G can be computed 
deterministically in time 0(|G|^/^) using Shanks' baby-step/giant-step method [20] or its 
variants [21]. Here, for two functions / and g with appropriate domains and ranges, 
the notation g{n) = 0{f{n)) means that there exists a positive constant c such that 
g{n) = 0{f{n)([og{f{n))Y). In the following proposition we show that the decomposition 
of an element in an abelian group can be found efficiently by a very similar approach (we 
will need this in Section [5]). 

Proposition 3.1. Let A be an abelian group and {gi, . . . ,gs) be a basis of A. There exists 
a deterministic algorithm with time complexity 0(|A|^''^) that, given any element g £ A, 
outputs integers ai, . . . , such that g = g^^ ■ ■ ■ g^" . 

Proof. Denote rj = ^/\gi\ for each i G {1, . . . , s} and, for simplicity, suppose that rj is an 
integer. The case where is not an integer is similar. The algorithm first computes the set 
S = {gl^ • • • ds" I'^i ^ {0, . . . , rj — 1}}. Then the algorithm tries all the elements (61, ... , bs) 
with 6i G {0, . . . , rj — 1} until finding an element (61, ... , bs) such that ggi^^^^ • ■ ■ gj''"^" & 

S. Denote ggi^^^^ ■ ■ ■ gj^"^'' = ' ' ' ds" i where each q is an element of {1, . . . , rj — 1}. 
A clever way for finding the Cj's is to use an appropriate data structure for storing S. 
Then the algorithm outputs (ri6i + ci, . . . ,rs6s + Cg). The correctness of this algorithm 
follows immediately from the fact that, if 5 = g^^ ■ ■ ■ 5^^, then each Oj can be written as 
ffli = biri + Ci for some bi and q in {0, . . . , — 1}. Its complexity is 0(| □ 
We now show how to compute a standard decomposition of any group in the class in 
time polynomial in the order of the group. The key part of the algorithm is the following 
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procedure Find-Decomposition that, given a group G in ^ and an integer m, computes 
an element of &q if this set is not empty. The description is given in metacode, fohowed 
by more details. 

Procedure Find-Decomposition(G, m) 

INPUT: a set of generators {gi, . . . , Qs} of a group G \n ^ with s = 0(log |G|) 

a positive integer m dividing \G\ 
OUTPUT: an error message or a pair (M, z) where z £ G and M is a subset of G 

1 compute a set of generators {xi, . . . , xt} of G' with t = 0(log |G|); 

2 factorize m and write m = ■ ■ ■ pp' ; 

3 search indexes /ci, . . . , A;^ G {1, . . . , s} such that divides \gki\ for each 1 < i <r\ 

4 if no such r-uple (/ci, . . . , kr) exists 

5 then return error; 

6 else 

-7 rrr 

7 9^ n^=i% ; 

8 if m does not divide \g\ 

9 then return error; 

10 else 

11 z'^g\9\/'^- 

12 for J = 1 to s do hj ^ gf] 

13 if (xi, . . . , xj, /ii, . . . , /is) is abelian 

and gcd{\xi\,m) = 1 for each i G {1, . . . , t} 
and (7cd(|/i£|, m) = 1 for each £ G {1, . . . , s} 

14 then return ({xi, . . . , x^, /ii, . . . , /is}, z); 

15 else return ERROR; 

16 endelse 

17 endelse 

At Step 1 a set of generators {zi, . . . , Zf} of G' with t' = O(s^) can be computed using 
O(s^) group operations by noticing that G' = {gkidi, 9j]gi^^ J; ^ G {1, . . . , s}) (we refer 
to [10] for a proof of this simple fact). Since G' is abelian for any group G in the class J^, a 
generating set {xi, . . . , xt} of G' with i = 0(log \G\) can then be obtained in time 0(|G|^/^) 
using the deterministic algorithm by Buchmann and Schmidt [5] that computes a basis of 
any abelian group K in time 0(|i^|^/^). At Step 2 the naive technique for factoring m 
(trying all the integers up to ^/m) is sufficient. This takes 0(|G|"^/^) time. At Steps 3, 7 
and 13 we use Shanks' method [20j to compute orders of elements of G in time 0(|G|^/^). 
At step 13, commutativity is tested by checking that every two generators commute: this 
can be done in 0{s^ + 1^) group operations. Proposition 13.21 below summarizes the time 
complexity of the procedure and prove its correctness. We state first one simple lemma. 

Lemma 3.2. Let G be a group in 5^ and {A, B) he a standard decomposition of G. Denote 
\B\ = m. Let {gi, . . . ,gs} be a set of generators of G. Then A = {G',gY^, . . . where 
G' is the derived subgroup of G. 

Proof. Let B = {y) and, for each i G {1, . . . ,s}, write gi as Zjy'^' for some zi £ A and 
ki G {1, . . . , m}. Then A = {G' , zi, . . . , Zg). Notice that G' has to be included since in 
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general A / {zi,...,Zs), e.g. G = {xi,X2,y \ xf = = y"^ = e,yxi = X2y,yx2 = xiy) 
with the generating set gi = xiy and g2 = V- A simple computation shows that g"^ = 
u-^mymki _ u^zf^ for some element Ui G G'. Since m is coprime with the order of Zi, we 
conclude that ^ = □ 

Proposition 3.2. The time complexity of the procedure Find-Decomposition(G, m) is 
0(|G|^/^). If / 0, then Find-Decomposition(G, m) outputs a pair {M,z) such that 
{{M),{z))) G Conversely, i/ Find-Decomposition(G, m) does not output an error 

message, then its output (M, z) is such that {M,z) £ 5^ and ((M), {z)) G ^(^f 

Proof. It is clear that the procedure always terminates since no loop is used. The time 
complexity follows from the analysis of Steps 1, 2, 3, 7 and 13 already done, and from the 
fact that s = 0(log|G|). 

Suppose that S!q 7^ and take a decomposition (^4, (y)) G S!q. Write m = p^^ ■ ■ ■pf.'^ 
for primes pi < ■ ■ ■ < pr and denote qi = p\^ for each i G {1, . . . , r}. Notice that for any 
generating set {(/i, . . . ,gs) of G, and for each i G {1, . . . ,r}, there should be some index 
kg for which is of the form ugy'^^ , where ui G A and q is such that qi divides the order 
of y'^', i.e. qe divides m/ gcd{m, cg). Also notice that in this case qg divides the order of 

gk^ as well. Then the element gk^ = g'^^^^^^'^' has order qi and, more precisely, is of the 
form viy'^^ for some V£ A and some dg = j£m/qi with 7^ coprime with m. Then the 
element g = H^^^^^,^ is of the form wy'^ where w £ A and d = di + ■■■ + dr is coprime with 
m. Thus m divides \g\ and z = g\9\/"^ is an element of order m of the form w'y^ with e 
coprime with m. From Lemma [3.2l we know that (xi, . . . ,xt,hi, . . . , hg) = A and conclude 
that {{xi,...,xt,hi,...,hs),{z)) G 

We now prove the last part of the proposition. Suppose that the algorithm does not err 
and denote {M,z) its output. Then z has order m and (M) is an abelian subgroup of G 
of order coprime with m, since the tests at steps 8 and 13 succeeded. Moreover (M) is 
normal in G since G' < (M). We conclude that (M, z) G y and ((M), (z)) G □ 

We now present an algorithm computing a standard decomposition of any group in =5^. 

Theorem 3.1. There exists a deterministic algorithm that, on an input G in the class 
5^ given as a black box, outputs an element z £ G and a set M of elements in G such 
that {{M),{z)) is a standard decomposition of G. The time complexity of this algorithm 
zsO(|G|i/2+"(i)). 

Proof. The algorithm is as follows. Let G be a group in the class =5^, input as a black box 
with generating set {gi, . . . ,gs} where s = 0(log |G|). 

We first compute \gi\ for each i G {l,...,s} using Shanks' algorithm. Let fh be the 
least common multiple of the s integers . . . , We compute the set S of divisors of 
m, and denote mi < m2 < ■ ■ ■ < rrir the elements of S in increasing order. 

For i from 1 to r we run the procedure Find-Decomposition(G, rrij) on the set 
{gi, . . . ,gs} and mj, and obtain an error message or an output {{Mi),Zi). Let n be the 
maximum value of the quantity mj|(M,)| over all the z's such that the output is not an 
error message (we will show that for at least one value of i the output is not an error mes- 
sage so n is well defined). Notice that computing |Mj| can be done using the deterministic 
algorithm by Buchmann and Schmidt [5j that computes the order of any abelian group 
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K in time 0(11^1^/^). Finally the algorithm takes the smallest integer E {1, . . . , r} such 
that mjQ|Mjg| = n, and then outputs Zjg and Mj^. 

We now analyze this algorithm. First of all notice that for any m such that is not 
empty, this integer m is in S since m divides rh. By Proposition 13.21 if is not empty 
then the procedure Find-Decomposition(G, mj) outputs an element ((Mj), (zj)) G 
and then mj|(Mj)| = Conversely, and again by Proposition 13. 2^ if the procedure 

Find-Decomposition(G, rrij) outputs {Mi,Zi), then mi\{M)\ = \{zi,Mi)\ < \G\. Thus 
n is well defined and is equal to the order of G. Finally, trying all the elements of S 
gives clearly the minimal m such that &q is not empty. Then ( {Mi^ ),Zi^) is a standard 
decomposition of G. The time complexity of the algorithm is shown to be 
using Proposition 13.21 and the following two facts. First, computing the set S can be done 
in 0(|G|^/^) time. Second, the number of divisors of any integer k has for upper bound 
0{k^) for any positive constant e (see for example [8]). Since m < |G| we conclude that 
r = |G|°(^). □ 
Remark. The space complexity of the algorithm of Theorem 13.11 is G)(y^|G|) since the 
baby-step/giant-step method requires this amount of space. An algorithm working in 
space polynomial in log |G| can also be constructed but in this case the time complexity 
gets worse (but is still polynomial in 

4 Testing Conjugacy 

In this section we study the automorphism group of any abelian group and describe how 
to decide whether two automorphisms are conjugate. 

Let A be a finite abelian group. Then A is the direct product of all its Sylow subgroups. 
Since Aut{A) is the direct product of the automorphism groups of the Sylow subgroups, 
we can assume without loss of generality that A is an abelian p-group for some prime p. 
In this section we suppose that A is isomorphic to the group Z^ei x • • • x Zp^s , for some 
positive integers s and ei < 62 < . . . < e^. 

4.1 Automorphisms of an abelian group 

We first introduce a matricial characterization of the automorphism group of A, follow- 
ing the work of Ranum [19] . 

Let (51, . . . ,5s) be a basis of A, i.e. s elements of A such that the order of each gi is 
p*^* and such that ^ = (51) x • • • x {qs)- Let ^ be an endomorphism of A and, for each 
j G {1, . . . , s}, denote i^{gj) = 5"^^ . . . g^"^ where each Uij is in the set {0, . . . — 1}. 
The values Ujj, which can be seen as an integer matrix {uij) of size s x s, fully define the 
endomorphism ip. However the converse is not true: an arbitrary integer matrix {uij) of 
size s X s with each value Uij in {0, . . . , p*^' — 1} does not necessarily define an endomorphism 
of A, because should be a homomorphism, and not only a linear map. It is easy to give 
necessary and sufficient conditions for these values Uij to define an endomorphism of A: 
pe.t-e-min(i,j) should divide Uij for any i, j G {1, . . . , s}. 

Definition 4.1. Define M{A) as the following set of integer matrices. 

M{A) = {{uij) £ If'^'' I < Uij < p*"* and p'^i-^'miniij) divides Uij for all i,j£{l,..., s}} 

Given U and U' in M{A) define the multiplication * as follows: U*U' is the integer matrix 
W of size s X s such that Wij = {J2k=i^ik''^'kj modp*^') for i,j £ {1,... ,s}, i.e. after 
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computing the usual matrix multiplication UU' , each entry is reduced modulo p^^ , where i 
is the row of the entry. Let R{A) be the set R{A) = {U £ M{A) \ det{U) ^ mod p} . 

Ranum has shown that the set R{A) corresponds to the set of automorphisms of A [19j . 

Theorem 4.1. (119]) The set R{A) with the product operation * is a group isomorphic to 
the group of automorphisms of A. 

Let us consider a few important examples to ihustrate the definitions introduced.® 

Example 4.1. If j4 = for some integer s, then M{A) is the set of matrices of size s x s 
over the finite field Zp and R{A) is the general linear group GLs{p) of invertible matrices 
of size s X s over Zp. 

Example 4.2. Let A be the group Z„ x Z„2 x Z„2 x ZpS, then 



M{A) = < 





1 An 


Al2 


Al3 


Al4 


\ 




pA2i 


A22 


A23 


A24 






pAsi 


A32 


A33 


A34 






V P^A41 


P^A42 


P^A43 


A44 


/ 



< \ij < p^" 



(1) 



4.2 Structure of the automorphism group 

We analyze now in more details the structure of the group R{A). Several new definitions 
are introduced and we refer to the end of this subsection for an example. 

We write A = Hi x - ■ ■ x Ht with Hi = Z^}. where /i < /2 < • • • < /< are positive strictly 
increasing integers and ki, . . . ,kt are positive integers. Notice that t and these integers are 
uniquely determined. In particular /j is the i-th smallest element in the series (ei, . . . , Cg) 
and ki is the number of times fi appears in the series. Also notice that ki + ■ ■ ■ + kt = s. 

Let U = (uij) be an element of M{A). We define t blocks Di{U), . . .,Dt{U) of U as 
follows: Di{U) is the matrix of size ki x ki obtained by selecting the rows and columns 
with indexes from {ki + • • • + + 1) to {ki + • • • + ki-i + ki). Notice that Di{U) is a 
matrix in M(Hi) which lies on the diagonal of U. For any matrix U in M{A) and any 
i £ {1, . . . ,t}, denote [U]i the matrix obtained by reducing the entries of Di{M) modulo 
p. Each [U]i can then be seen as an element of GLk.{p). For each i £ {1, ■ ■ . ,t} we also 
define the following subset of M{Hi). 

Ki{A) = {{uij) G M{Hi) I p divides {uij - 5ij) for all j e {1, . . . , ki]] . 

In the definition of Ki{A), 6ij is the Kronecker symbol (equal to 1 if i = j and equal 
to otherwise). In other words, each diagonal entry of a matrix in Ki{A) is of the form 
1 +pXii and each non-diagonal entry is of the form pXij. Finally we introduce the following 
definition. 

Definition 4.2. Consider the subset N(A) of M(A) defined as follows. 

N{A) = {U £ M{A) I Di{U) £ Ki{A) for each i£{l,...,t]] 
Also consider the subgroup V{A) of the group GLs{p) defined as 

V{A) = {A£ GLs{p) I V = diag{Vi, . . . ,Vt) with Vi £ GLk, (p) for each i £ {I, . . . ,t]] . 
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Let ^ be the map from R{A) to V{A) such that ^{U) = diag{[U]i, . . . ,[U]t) for any 
U G RiA), i.e. the diagonal blocks of A are reduced modulo p and the others entries are 
mapped to zero. 

We now prove the fohowing result. 

Proposition 4.1. ^ is a surjective group homomorphism from R{A) to V(A). Its kernel 
is N{A). 

Proof. ^ is clearly surjective and ^'^^(/) = A^(^) where / denotes the identity of V{A). 
Take two arbitrary matrices U and U' in R{A). To prove that ^ is an homomorphism we 
have only to prove that [U * U']i = [U]i[U']i for each i S {1, . . . , s}. This is easy to show 
by noticing that all the entries on the left and below the diagonal blocks of U and U' are 
divided by p. □ 

PropositionHTUshows that N{A) is a normal subgroup of R{A) and R{A) /N{A) = V{A). 

Example 4.3. Let A be again the group Zp x Zp2 x Zp2 x ZpS. Then t = 3, /i = 1, 
/2 = 2, /s = 5, fci = ^3 = 1 and k2 = 2, i.e. Hi = Zp, H2 = I?2 and = ZpS. 
Then, using the notation for a general element U in M{A) used in Equation ([1]) we 

obtain Di{U) = (An), D2{U) = ( ) , and D3{U) = (A44). The sets Ki{A) 

V A32 A33 J 

are as follows: Ki(A) = {(1)}, K2(A) = \ ( ^ +^"11 ^"12 \ I < a^, < p\, and 

1^ V P"2i l+pa22 J J 
K3{A) = {(1 +pa) I < a < p^}. We conclude that 





/■ 


/ c. 


A12 Ai3 


Al4 


N{A) = < 




PA21 
PA31 


C2 


A24 
A34 






V /A41 


p-^\i2 P^A43 


C3 



0<A,, <p'=— (^.^),CfcGi^fc(A) V. (2) 



Then V[A) is the set of matrices of the form diag{Vi, V2, V3) where Vii V3 G GLi{p) and 
V2 £ GL2{p). Finally we give an example of the action of ^ (suppose here that p ^ 2): 



^ : 



2 


1 3 


P \ 




1 2 







3p 


1 p + 2 


P+l 







1 2 





P 


p + 1 p 


2 


1 — > 





1 





3/ 


pi 2pA 


p' + l ) 




V 





1 / 



4.3 Testing conjugacy in R{A) 

In this subsection we consider the following computational problem and present an 
efficient algorithm solving it. 

Conjugacy 

INPUT: an abelian p-group A and two matrices Ui and U2 in R{A) such that 

the orders of Ui and U2 are coprime with p (3) 
OUTPUT: an element U G R{A) such that U *Ui = U2*U if such an element exists 
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The problem CONJUGACY asks to check whether two matrices Ui and U2 in R{A) 
satisfying condition ([3]) are conjugate in R(A). Trying all the possibilities for U requires 
trials. Since for example in the case A = Z^j. with p and k constant the bound 

\R{A)\ = e(|A|i°gl^l) holds, such a naive approach is not efficient. However, notice that 
in the case A = the group A has more than the structure of an abelian group: A is 
a vector space over the field Zp and then R{A) = GLs{p)- A mathematical criterion for 
the conjugacy of matrices in GLs{p) (even without the condition ^ on their orders) is 
known: two matrices are conjugate if and only if their canonical rational forms are equal. 
Since the canonical rational form of a matrix can be computed efficiently [23] . this gives 
an algorithm solving the problem CONJUGACY in time polynomial in log 1^41. However, 
when A has no vector space structure, there is no known simple mathematical criterion 
for the conjugacy of matrices and, to our knowledge, no algorithm faster than the above 
naive approach is known, even for the case where A = Z^a- We now show that with the 
additional condition ([3]) on the order of Ui and U2 there exists an algorithm solving the 
problem CONJUGACY in time polynomial in log |^| for any abelian p-group A. 

Our algorithm is based on the following proposition, which is a generalization of an 
argument by Pomfret |18j . 

Proposition 4.2. Let A be an abelian p-group and Ui,U2 be two matrices in R{A) of 
order coprime with p. Then Ui and U2 are conjugate in R{A) if and only if^{Ui) and 
^{112) are conjugate in V{A). Moreover ifUi and U2 are conjugate in R{A) then for any 
X £ R{A) such that '^{Ui) = ^{X)'^'^{U2)'^iX) there exists a matrix Y G N{A) such 
that X *Y *Ui = U2* X *Y. 

Proof. For brevity we omit the symbol * when denoting multiplications in R{A). Since 
^ is an homomorphism, if Ui and U2 are conjugate in R{A) then ^(Ui) and ^{1/2) are 
conjugate in V{A). Now suppose that ^'(C/i) and "^{1/2) are conjugate in V{A). Since the 
image of ^' is V{A), there exists some X £ R{A) such that ^{Ui) = ^{X)~^^{U2)^{X) 
and thus Ui = X-W2XM for some M G N{A). Then {Ui)N{A) = {X-'^U2X)N{A) 
(since N{A) is a normal subgroup of R{A)) and the two subgroups (Ui) and {X^^U2X) 
are Hall subgroups of the group {Ui)N{A). Moreover since {Ui)N{A) is a cyclic extension 
of the p-group N{A), this is a solvable group. Then, from Theorem 12.11 this implies that 
the two subgroups {Ui) and {X~^U2X) are conjugate in {Ui)N{A) and thus there exists 
an element Y £ {Ui)N{A) and some r > such that Y-^X-^U2XY = UI- Without 
loss of generality Y can be taken in N{A). Thus ^'(C/i) = ^{X)-^'^{U2)'^{X) = ^'(C/i)^ 
Since the order of the kernel of ^ is coprime with the order of Ui, the matrices Ui and 
^{Ui) have the same order, and thus Ui = We conclude that Y~^X~^U2XY = Ui. 
The matrices Ui and U2 are thus conjugate in R{A). The second part of the theorem 
follows from the observation that X can be chosen in an arbitrary way. □ 

We now present our algorithm. 

Theorem 4.2. There exists a deterministic algorithm that solves the problem Conjugacy 
in time polynomial in log|A|. 

Proof. The algorithm is as follows. 

Given Ui and U2 in R{A) satisfying Condition we first compute the two matrices 
Vi = ^{Ui) and V2 = ^(f/2) in V{A). Then we check the conjugacy of Vi and V2 in V{A) 
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using the following approach. Vi and V2 are conjugate in V{A) if and only if the blocks 
Di{Vi) and Di{V2) are conjugate in GLk-{p) for each i G {1, . . . that is, if Di{Vi) and 
Di{y2) have the same rational normal form. The rational normal form of matrices of size 
n X n (and transformation matrices) over any finite field can be computed using O(n^) 
field operations (see for example [23]). Thus we can decide in time polynomial in log |^| 
whether Z)j(Vi) and Di{V2) are conjugate for all i G {1, . . . , i}. If this is not the case then 
we conclude that Ui and U2 are not conjugate in R{A) from Proposition 14.21 Otherwise 
Ui and U2 are conjugate in R{A) and the remaining of the proof shows how to compute 
a matrix U G R{A) such that U *Ui = U2*U. 

We compute transformation matrices Tj G GLk^ip), for i G {l,...,t}, such that 
TiDiiVi) = Di(y2)Ti using, for example, again the algorithm [23]. Then we take any 
matrix X in R{A) such that ^{X) = diag{Ti, . . . ,Tt), e.g. the matrix X in R{A) with 
diagonal blocks equal to Ti, . . . ,Tt and zero everywhere else. We finally determine a so- 
lution Y in N{A) of the matrix equation X * Y * Ui = U2 * X *Y. Such solution exists 
by Proposition 14.21 To do this, we write the general form of an element Y of N{A) using 
variables yij: the entry corresponding to the i-th row and the j-th column of Y, for 
i,j G {1, . . . is of the form (1 + pi/ij) if i = j and is of the form p'^^^Uij for some 
appropriate nonnegative integer dij otherwise (see Equation ([2]) for an example). Then 
the equation X *Y *Ui = U2* X *Y can be rewritten as the following system of linear 
modular equations of variables y-ij: 

s 

af/\ij = (5^^^^^ mod for 1 < A;, ^ < s, 

where ajj'^^ and /J^'^'^) are known. Now we add on each modular equation a new variable 
Zke. with coefficient p^'' . This transforms the above system into the following system of 
linear Diophantine solutions of 2s^ variables: 

s 

a'^''\i,+p''^ZM = P^'''^ foTl<k,e< s. 

It is known that any system of linear Diophantine equations with ni equations and 112 
variables can be solved in time polynomial in ni, n2 and logA^, where N is the largest 
coefficient appearing in the system [6]. Then a solution Y G N{A) of the equation X * 
Y * Ui = U2 * X *Y can be computed in time polynomial in log \ A\. The output of the 
algorithm is the matrix X *Y. □ 

5 Our Algorithm 

In this section we give a proof of Theorem 11.11 We first present the following rather 
simple result that shows necessary and sufficient conditions for the isomorphism of two 
groups in S^. 

Proposition 5.1. Let G and H be two groups in 5^. Let (^i,(yi)) and (^25(^2)) 
standard decompositions of G and H respectively and let ipi (resp. ip2) he the action by 
conjugation of yi on Ai (resp. 0/7/2 on A2). The groups G and H are isomorphic if and 
only if the following three conditions hold: (i) Ai = A2; and (ii) \yi\ = \y2\; o,nd (Hi) there 
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exists an integer k £ {l,...,|yi|} coprime with \yi\ and an isomorphism ip : Ai ^ A2 
such that (fi = ip~^ip2'ip. 

Proof. First notice that for a group G in J^, the integer 7(G) is a group invariant. Now 
suppose that G and H are two isomorphic groups in ^ with standard decomposition 
respectively and (^2, (2/2))- Then = \y2\ = 7(G) = j{H). Denote by ip an 

isomorphism from G to H and notice that {'ip{Ai),'il){yi)) G From Lemma l3.1l this 

imphes that tp{Ai) = A2 and, in particular, Ai = A2. The element ip{yi) can be written as 
zy2 for some z £ A2 and some integer k G {1, . . . ,j{H)} coprime with 7(-ff). By definition 
of (pi, for any x G Ai the relation yix = iyixy^^)yi = (fi{x)yi holds. Applying ijj to each 
term gives 

zylHx) = ^p{Mx))zy2 
ip^{ip{x))zy^ = ipiipi{x))zy^ 

for any x Ai. Thus ip2 = ipipi'tp~^. 

Now consider two groups G and H in J/" satisfying the conditions (i), (ii) and (iii) of 
the statement of the theorem. Denote m = \yi\ = \y2\- Let fj, be the map from G to H 
such that ^{xyi) = ilj{xi)y2^ for any x in Ai and any j G {0, . . . , m — 1}. The map /x is 
clearly a bijection from G to H. We now show that ^ is a homomorphism, and thus an 
isomorphism from G to H. Let x and x' be two elements of Ai and let j and j' be two 
elements of G {0, . . . ,m — 1}. Then 

ld{xylx'y{ ) = fi{xip{{x')yl'^^ ) = 'il^{xip{{x'))y2'-^^^ ^ = i}{x)i}{ip{{x'))y^^^^^ \ 

Now the relation ix{xy\) ii{x' y\ ) = ijj{x)y2'^ ijj{x')y2'^ = ip{x)(p2'^ {ip{x'))y2^''^'' "* holds. Con- 
dition (iii) of the statement of the theorem implies that il:{(p{{x')) = Lp^\il){x')) and thus 
^{xy{x'y[ ) = n{xy{)fi{x'y{ ). □ 

Remark 1. Notice that the integer k in Proposition 15.11 cannot always be taken 
equal to 1. For example consider the groups {xi,yi \ xl = yf = e,yixi = x\yi) and 
{x2,y2 \ ^2 = y2 = e.,y2X2 = X2^y2): the map yi 1-^ ^1 ^2 extends to an 

isomorphism (because 2/2^2 = 2:22/2) but no isomorphism mapping yi to y2 exists. 

Remark 2. Proposition 15.11 can be used to give a (partial) mathematical classification 
of the number of groups of the form A x Zm- We refer to Appendix A for a sketch of how 
this can be done. 

We now present our proof of Theorem II. 1[ 

Proof of Theorem \l.l[ Suppose that G and H are two groups in the class J^. Denote 
n = min{\G\, \H\) and 7 = min{'y{G),^{H)). In order to test whether these two groups 
are isomorphic, we first run the algorithm of Theorem 13.11 on the inputs G and H and 
obtain outputs (5i,?/i) and (52,2/2) such that {{Si), (yi)) and {{S2), (2/2)) are standard de- 
compositions of G and H respectiveljl^. The running time of this algorithm is 0{n^/'^'^°^^^) 
by Theorem 13.11 Denote Ai = {Si) and A2 = {S2)- 

^Actually in order to obtain a running time bounded by n, and not by max{\G\, \H\), we need to run 
the algorithm of Theorem 13. II on the two inputs in parallel, compute the order of the group for which the 
algorithm first ends, and stop the computation if the algorithm takes too long on the second input. 
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We then check whether \yi\ = \y2\- If |yi| / |?/2| we conclude that G and H are not 
isomorphic by Proposition 15.11 Otherwise notice that |yi| = \y2\ = 7. Then we compute 
a basis ((71, ... , gg) of Ai and a basis {hi, . . . ,ht) of A2 using the algorithm by Buchmann 
and Schmidt [5]. The running time of this step is 0(n^/^). Given these bases it is easy to 
check the isomorphism of Ai and A2: the groups Ai and A2 are isomorphic if and only if 
s = t and \gi\ = \hi\ for each i € {1, . . . , s}. If ^1 ^ A2 we conclude that G and H are not 
isomorphic by Proposition 15. 1[ 

Now suppose that Ai = A2 (and then s = t) and denote R = R{Ai) = R{A2). We want 
to decide whether the action by conjugation (pi of yi on Ai and the action by conjugation 
ip2 of 2/2 on A2 satisfy Condition (iii) in Proposition 15. II Let p^^ ■ ■ -pf^ be the prime power 
decomposition of |^i| = 1^21, with pi < ■ ■ ■ < Pd and denote Pi the Sylow pj-subgroup 
of Ai for each i G {l,...,r}. We compute the matrix Mi in R corresponding to the 
automorphism ifi of Ai with respect to the basis {gi, . . . ,gs)- More precisely let us denote 
Viidi) = yidiUi^ = ■ ■ ■ for each i G {1, . . . , s}. The values Uij for each i can be 
found by using the algorithm of Proposition 13.11 on the input yigiyi^- Then the matrix 
All = {uij) can be computed in time 0(n^/^). Similarly we compute the matrix M2 G R 
corresponding to the automorphism ip2 of A2 with respect to the basis {hi, . . . ,hs). A key 
observation is that Mi and M2 are block diagonal, consisting in r blocks. More precisely 
the z-th block is a matrix in R{Pi). 

Finally for each integer k G {1, . . . , 7} coprime with 7, we test whether Mi and are 
conjugate in R. This is done by using the algorithm of Theorem 14.21 to check whether, for 
each i G {1, . . . ,r}, the i-th block of Mi is conjugate to the i-th block of M2 in R{Pi). 
If there is no k such that Mi and are conjugate in R we conclude that G and H are 
not isomorphic. Otherwise we take one value k such that Mi and M2 are conjugate and 
compute an explicit block diagonal matrix X m. R such that Mi = X~^M2X. This can 
be done in time polynomial in log n by Theorem l4.2[ The matrix X is naturally associated 
to an isomorphism ^ from Ai to A2 through the bases {gi, . . . ,gs) and {hi, . . . , hg)- The 
map fi : G ^ H defined as fJ'{xyi) = ip{x)y2'' for any x G Ai and any j G {0, . . . , 7 — 1} 
is then an isomorphism from G to H (see the proof of Proposition 15.11 for details). The 
total complexity of this final step is 0(7log'^n) for some constant c. 

The global time complexity of this algorithm is 0(7log'^n) + 0{n^^'^~^°^^^) < {^/n -\- 
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Appendix 

A The Number of Isomorphism Classes 

We briefly mention a sketch of how our results can be used to derive the number of 
isomorphism classes of groups of the form A xi for some given abelian group A and 
positive integer m such that gcd{\A\,m) = 1. We only work out the rather simple case 
where A = and m = 4 here. We believe that this gives an insight of the usefulness of 
our results and of the rich mathematical structure of the class of groups J^. 

Let G = A Xi (y) where |y| = 4 and A = for some positive integers i and r. Then 
the action by conjugation of y over A can be written as a matrix M in R{A). Notice 
that necessarily = /. From proposition 15.11 two distinct actions Mi and M2 define 
isomorphic groups if and only Mi and are conjugate in R{A) for = 1 or A; = 3. We 
will show that, for A = and m = 4, the matrices Mi and M2 are conjugate in R{A) 
if and only if Mi and M| are conjugate in R{A). Thus, in this case, Propositions 14.21 
and lS.ll implv that Mi and M2 define isomorphic groups if and only if ^'(Mi) and ^{M2) 
are conjugate in V{A) = GLr{3). We stress that for other values of A and m this is not 
always the case (see for example the isomorphic groups {xi,yi \ xl = yf = e,yixi = xfyi) 
and {x2,y2 I = 2/2 ~ ^:y2X2 = 2^2^2/2) already mentioned in Section E]). 

The number of conjugacy classes of matrices of a given order s in the general linear 
group GLr{p) is well known [9j, although usually difficult to write down in a concise way. 
This number is related to the factorization of the polynomial X* — 1 in the field Zp through 
the concept of the canonical normal form of a matrix. For example for the values s = 4 
and p = 3 the factorization is - 1 = (X + 1)(X - 1){X^ + 1). Let U, V and W be the 
companion matrices associated to the polynomial X + 1, X — 1, and X^ + 1 respectively. 
Then properties of the canonical normal form show that any matrix of order dividing 4 
in GLr{3) is conjugate to a unique block diagonal matrix where the first ki blocks are U, 
the next /c2 blocks are V and the last blocks are W, for some (fci, k2, k^) € Sr- Here Sr 
denotes the set {(fci, A;2, k^) \ki>0, k2> 0, fcs > 0, fci + /c2 + 2/03 = r}. Thus there 
I conjugacy classes of matrices of order dividing 4 in GLr{3). 

A key observation is now that is conjugate to U in GLi(3), is conjugate to V in 
GLi(3) and is conjugate to W in GL2(3). Thus if Mi and M| are conjugate in R{A) 
then necessarily Mi and M2 are conjugate in R{A) too. We conclude that the number of 
isomorphism types for the groups Zg^ x Z4 is \Sr\- For example the number of isomorphism 
types for Z3 x Z4 is 9, as mentioned in the introduction of this paper. 
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